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Abstract 

This paper is concerned with decentralized estimation of a Gaussian source using multiple sensors. We consider 
a diversity scheme where only the sensor with the best channel sends their measurements over a fading channel to a 
fusion center, using the analog amplify and forwarding technique. The fusion centre reconstructs an MMSE estimate 
of the source based on the received measurements. A distributed version of the diversity scheme where sensors 
decide whether to transmit based only on their local channel information is also considered. We derive asymptotic 
expressions for the expected distortion (of the MMSE estimate at the fusion centre) of these schemes as the number 
of sensors becomes large. For comparison, asymptotic expressions for the expected distortion for a coherent multi- 
["T i ■ access scheme and an orthogonal access scheme are derived. We also study for the diversity schemes, the optimal 

power allocation for minimizing the expected distortion subject to average total power constraints. The effect of 

■ optimizing the probability of transmission on the expected distortion in the distributed scenario is also studied. 
It is seen that as opposed to the coherent multi-access scheme and the orthogonal scheme (where the expected 
distortion decays as 1/M, M being the number of sensors), the expected distortion decays only as l/hx(M) for 
the diversity schemes. This reduction of the decay rate can be seen as a tradeoff between the simplicity of the 
diversity schemes and the strict synchronization and large bandwidth requirements for the coherent multi-access 
and the orthogonal schemes, respectively. It is proved that optimal sensor transmit power allocation achieves the 
same asymptotic scaling law as the constant power allocation scheme, whereas it is observed that optimizing the 
sensor transmission probability (with or without optimal power allocation) in the distributed case makes very little 

■ difference to the asymptotic scaling laws. 

m 

I. Introduction 

', Wireless sensor networks have received much recent interest in the research community. Many different schemes 
O | for decentralized estimation of sources using multiple sensors have been proposed, e.g. One popular 

^ ■ technique is analog amplify and forward Q, (H, where sensors transmit over fading channels a scaled version 
. . ! of their analog measurements to a fusion center, and has been shown to be optimal in some situations |9). Analog 
forwarding under different multiple access schemes such as coherent multi-access Q, iflOl and orthogonal access 
flTTl . with correlated data between sensors lfl2ll . lfr3ll . and different network topologies lfl4l . have also been studied. 

One problem with the analog amplify and forwarding technique is that it appears to be hard to implement, 
especially when the number of sensors is large, e.g. it is difficult to synchronize a large number of sensors in the 
multi-access scheme (though studies suggest that even without perfect synchronization much of the gains can still 
be achieved (U, |fl"5l ), while there might not be a sufficiently large number of orthogonal channels available in the 
orthogonal scheme. This paper will study the performance of the analog forwarding technique using multiple access 
schemes which may be easier to implement, based on the concept of multi-user diversity lfl6ll . ifTTl . Multi-user 
diversity refers to different users experiencing good channel conditions at different times, and can be exploited 
in the following manner: For the problem of maximizing the sum rate subject to average power constraints, the 
optimal solution is to schedule the users such that at most only one user transmits, with this user being the one 
having the best channel conditions at that instance. 

In this paper we will study the use of a similar diversity scheme in the decentralized estimation of a Gaussian 
source. In this scheme, which we will refer to as the multi-sensor diversity scheme, the sensor with the best channel 
conditions at that time will amplify and forward its measurement to the fusion center, while the other sensors do 
not transmit. The multi-sensor diversity scheme requires knowledge of all the channel gains in order to decide on 
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the best channel. A distributed version of the multi-sensor diversity scheme, similar to a distributed version of the 
multi-user diversity scheme studied in lfT8l (see also [19]) called the channel-aware ALOHA scheme, will then also 
be considered. 

In this paper we are interested in the asymptotic behaviour of such schemes as the number of sensors M goes 
to infinity. It is shown that in many cases the expected distortion (where the expectation is with respect to the time 
varying channel gains) decays to a non-zero limit at the rate l/ln(M). As a comparison we will also derive the 
expected distortion of the multi-access and orthogonal access schemes, which decay at the rate l/M for large M. 
These results are similar to the existing asymptotic results for the distortion in the multi-access scheme O-Hl and 
orthogonal access scheme [11], however the expected distortion is not considered explicitly in these works. Note 
also that characterising performance via expectations has also been used in e.g. Kalman filtering with intermittent 
observations ll20l . where the behaviour of the expected error co variance was studied. Another related concept is 
the distortion exponent lETTl . which relates the expected distortion with SNR under different source and channel 
encodings, as the SNR goes to infinity. 

We will also be interested in deriving the optimal power allocation to minimize the expected distortion subject 
to average power constraints. We will study this problem for the multi-sensor diversity and channel-aware ALOHA 
schemes. For the channel-aware ALOHA scheme, we will also consider the problem of optimizing the thresholds 
which determine when individual sensors will transmit. The effect of these optimal power allocation and/or optimal 
threshold selection schemes on the asymptotic scaling laws for the expected distortion will be studied in detail. It 
will be shown that with optimal power allocation, the asymptotic scaling law of expected distortion remains the 
same as that with constant power allocation policy. It is also observed via numerical studies that with the optimal 
threshold selection in the distributed case (with or without optimal power allocation), the asymptotic scaling laws 
for expected distortion are very similar to that with an identical transmission probability of l/M across all the 
sensors and some weaker theoretical results are proved. 

The paper is organised as follows. Section JI] specifies our model and the different multiple access schemes used 
by the sensors to communicate to the fusion center. Section [III] derives for symmetric parameters the asymptotic 
behaviour for the multi-sensor diversity, channel aware ALOHA, multi-access, and orthogonal access schemes, 
followed by comparisons and discussions. We comment on whether the results for the symmetric case can be 
extended to general parameters in Section [IVJ Optimal power allocation for the multi-sensor and channel aware 
ALOHA schemes are considered in Section [V] It turns out that the performance of the simple constant power 
allocation of Section [III] is very close that with the optimal power allocation, and we will prove why this is the 
case. In Section [VI] we study the problem of optimal threshold selection in the channel-aware ALOHA scheme and 
its effect on the asymptotic decay rate of the expected distortion. Finally, Section VII presents some concluding 
remarks and future research directions. 



II. System models 

We wish to estimate a discrete time scalar signal Q k modelled as an i.i.d. bandlimited Gaussian source with zero 
mean and variance a"g, with k representing the time index. The Gaussian source is measured by M sensors with 
sensor i having measurements 

Vi,k = k + v i)k ,i = 1, ■ • • ,M 

with Vi^ being i.i.d. Gaussian with zero mean and noise variance af, with Vi k independent of Vj : k for i / j. Let 
gik be the randomly time-varying channel power gains from sensor i to the fusion center, and a^k the amplification 
factors in the amplify and forward scheme. We assume that and gj^ are independent for i ^ j. The transmit 
power of sensor i at time k is defined as 

7i,* = «?,fe E k 2 ,fc] = ^l k (crj + of) 

Next, we present the various multiple access schemes for transmitting the sensor measurements to a fusion center, 
considered in this paper. 
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A. Multi-sensor diversity scheme 

Let g max ^k = max(<7i . . . , gMk)> an ^ ^* tne index of the corresponding sensor. Consider a scheme where only 
the sensor with the best channel transmits its measurement to the fusion center. The fusion center then receives 

z k = ^9max,kOii%k{0k + W»*,fc) + Wfc 

where n& is i.i.d. Gaussian with zero mean and variance a\. Using the linear MMSE estimator [22], the mean 
squared error or distortion at time k can be easily shown to be 



B. Channel-aware ALOHA scheme 

The multi-sensor diversity scheme requires knowledge of all the channel gains in order to determine the sensor 
with the best channel. In practice this could be achieved by having each sensor transmitting a pilot signal to the 
fusion center, which may then be used by the fusion center to estimate the individual channel gains. The fusion 
center can then determine and inform the sensor that it has the best channel. However, as the number of sensors 
increases, there is increasing overhead involved and the multi-sensor diversity scheme may be prohibitive for large 
networks, see e.g. lfT8l . 

We consider now a scheme that we will call the channel-aware ALOHA scheme, that is based on a distributed 
scheme for multi-user diversity considered in |fl8l , see also |23l for a similar scheme in the distributed estimation 
of a constant parameter. In this scheme a sensor will forward its measurement to the fusion center only if g^ > T% 
for some threshold Tj. 

In |fT8l . choosing T\ such that Pr(<fe fc > Tj) = 1/M, Vi, was shown to be asymptotically optimal, in the sense 
that this gives the same rate of throughput scaling as in the multi-user diversity scheme, but with a fraction of 
throughput loss of 1/e (asymptotically). For much of this paper we will also use this choice of Tj. We discuss in 
Section [VI] how the transmission threshold can be optimized and the effect of the optimal threshold on the expected 
distortion and its scaling law for large M (assuming identical threshold for all sensors). 

In this scheme, if more than one sensor transmits, then a collision is assumed (whereby the fusion centre does not 
receive anything) and Dk = o~\. Similarly if no sensor transmits then also Dk = oj. If only one sensor transmits, 
then 



where i* is the index of the sensor that is transmitting. 
C. Multi-access scheme 

In the (coherent) multi-access scheme 0, iTTOl . the sensors transmit their measurements to the fusion center 
using the amplify and forward technique over a multi-access channel, so the fusion center receives the sum 

M 






(1) 



i=l 



The distortion at time k is given by 




E*=i 9i,kal k af + al + a 2 e (j^fli ^k^ 
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D. Orthogonal access scheme 

In the orthogonal access scheme ifTTl . the sensors transmit their measurements to the fusion center via orthogonal 
channels, so that the fusion center receives 

Zi,k = ^/gi^® iik {0k + «i,fc) + rii,k, i = !,■■■ ,M 
where n^k is i.i.d. Gaussian with zero mean and variance <J^,Vi The distortion at time k is given by 

III. Asymptotic analysis 

In this section, we are interested in deriving asymptotic expressions for E[Dfc] as M — > oo, where the expectation 
is over the random channel gains g^, for the different schemes of Section H] Due to the i.i.d. (in time) nature 
of the models we will drop the subscript k. For analytical tractability we will first analyze "symmetric" sensor 
networks with af = <r^,Vi, with the ^'s being identically distributed, and simple power allocation policies, e.g. 
constant power allocation. See Section [TV] for remarks on more general asymmetric situations, and Section [V] for 
optimal power allocation. Apart from the multi-access scheme, for the other schemes we will need to assume a 
specific distribution in order to obtain precise asymptotic results. In these cases we will assume Rayleigh fading 
(i.e, the channel power gains are exponentially distributed), though most of our analytical methods can be adapted 
to other fading distributions. 

Notation: For two functions f(t) and g(t), we will use the standard asymptotic notation (see e.g. [24]) and say 
that / ~ g as t — > to, if — > 1 as t — > to- It is well known that the asymptotic relation ~ is retained under 
addition, multiplication and division. 

Notation: Extending the use of the symbol ~ to functions of random variables, for functions f(t,ui) and g(t,uj), 
we will also say that / ~ g w.p.l as t — > to, if g(t'») — > 1 w.p.l as t — > to- For instance, if Xi are i.i.d., then 
Yli=i Xi ~ ME[Xl] w.p.l as M — > oo, which follows from the definition and the strong law of large numbers. 



A. Multi-sensor diversity scheme 

Let us use aj* = 1 (constant power allocation), and a>j = 0, Vj ^ i*. Considering Rayleigh fading, we first have 
the following Lemma: 

Lemma 3.1: Suppose the g^s are exponentially distributed with mean 1/A, and let b > be a constant. Then 



E 



1 



A 



A 



Aft + lnM ln(M) 



_9max ~\~ b 

See Appendix [A] for the proof of Lemma 13.11 

Remark: The expectation above can actually be evaluated exactly as 



as M — > oo 



1 



+ b 



^ /M-l\ 
fe=0 v 7 



(-l) fc exp(A(A; + l)b)E 1 (X(k + 1)6) 



(2) 



g max +b 



as M becomes large 



where E\{.) is the exponential integral. However characterising the behaviour of E 
from the exact expression (O does not appear obvious. 

With the help of Lemma 13.11 one can now prove the following result. 

Theorem 3.2: Suppose the g^'s are exponentially distributed with mean 1/A. Then in the multi-sensor diversity 
scheme with = 1, and ctj = 0,Vj ^ i* , 



E[D] 



a 2 e + a% 



1 + 



A 



al(al + al)HM)\ 



as M — > oo. 



(3) 
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Proof: We have 



D 



9n 



o- 2 e {9maxCrl + aj) 

9max 



2 2 / a ™ a ~» 

1 \ _Q 



al + al 



fjn 



+ 



Therefore 



E[D] 



Using Lemma 13.11 we then have 
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E[D] 
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al(a 2 g +al)HM) 



Hence as M — > oo, the expected distortion goes to ^_°" 2 at the rate l/ln(M). 



B. Channel-aware ALOHA scheme 

Recall that for this scheme, Tj is chosen such that Pr(g, > Tj) = 1/M. Again, with constant power allocation, 
let us use on = 1 if sensor i transmits. By the symmetry of the situation it is clear that Tj = T, Vz. Note that by 
the choice of T each sensor has probability 1/M of transmitting to the fusion center (some of which will result in 
collision), so the long term total (across sensors) average power usage is the same as in the multi-sensor diversity 
scheme. Considering Rayleigh fading, we have the following result: 

Theorem 3.3: Suppose the t/j's are exponentially distributed with mean 1/A. Let oti = 1 if sensor i transmits. 
Then in the channel-aware ALOHA scheme 



E[D] ~ of(l 



1. 



+ 



1 cria. 



2^2 



eai + at 



2^2 



1 + 



a„a, 



n u e 



A 



al(al + al)lnM 



as M — > oo. 



(4) 



Proof: We have 



Pr(no sensor transmits) = (Pr(<ft < T)) M 

1 



(1 



M' 



Pr(successful transmission) = MPr(sensor % transmits successfully) 

= MPrGfc>T)IJPr((& < T) 



M— (1 - — ) M - 1 
M M 



'1 - — 
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,Af-l 



Pr(collision) = 1 - (1 
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Then 



K[D] = cr| Pr(no sensor transmits) + cr 2 Pr(collision) 

-l 



+ 



4 



1 



1 



9i 



Pi{ 9i >T)J T \al 9i°l + ol 
1 



1 - (1 - — ) M - 1 
V M' 



p{gi)dgi x Pr(successful transmission) 

l 



9i 



v \<r§ gicri + cri 



p(gi)dgi 



+m ( i- v- 1 1+^4 



p(gi)dgi 



Since the g^'s are exponentially distributed with mean 1/A, T = ilnM and 



Hence 



E[£>] 



5 + ^ 
1-(1 



A ex.p(-Xg)dg = A exp(A6)£i (A(6 + T)) = A exp(A6)£i (Aft + In M) 



\M-1 



+ M < 1 - 77 



AT 



,M-1 



,-2^2 



CJgCr; 1 



2^-4 



+ 



cr„a 



n u 6 



2\2 



A exp 



Xal +lnM 



~ 00 (1 ) H 2~~^v 

2/-, !n , 1 O"! "^ 



e o| + cr 2 , l 



1 + 



1 + 



2 2 



+a v) lnM + 



2^2 



n u 9 



A 



(7^2 +<T 2 )lnM 

as M — > co, where we have used the asymptotic expansion 

e" 



E 1 {z) 



1 2 



The expected distortion in this case goes to cr 2 (l — \) + \ at the rate l/ln(M) as M — > oo 



C. Multi-access scheme 

For fairness of comparison, let us use here the scaling ctj = l/\/M,V«, which will result in the same total long 
term average transmit power usage as the multi-sensor diversity and channel-aware ALOHA schemes. 
Theorem 3.4: Let cij = 1/ \/M, Vi Then in the multi-access scheme, 



ggE[gi] + <r% 
M(E[V5l]) 5 



E[D] ~ as M ~> 00 • (5) 



Proof: We have 

L> = 



w.p.l 



provided the expectations K[gi] and E[y^i] exist, where the last line comes from applying the strong law of large 
numbers and the definition and properties of ~. Since D is always bounded, we can then use results on uniform 
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integrability, e.g. [25], to conclude that 



E[D] 



a%E[ 9l ] + a2+Ma 2 d (E[^}y 
a 2 v E[ gi ] + a 2 n 



M{E[^gl]f 



Thus the expected distortion decays to zero at the rate 1/M as M — > oo, similar to the scaling behaviour for the 
distortion derived in HI. 



D. Orthogonal access scheme 

Theorem 3.5: Suppose the g^'s are exponentially distributed with mean 1/A. Let «j = 1/y/M, VI Then in the 
orthogonal access scheme 

2(7i! 



E[D] 
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Proof: We have 
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w.p.l 



provided the expectation E[gi/{g\a1 + o ,2 l )] (and hence E[gi/(gia 2 + Mcr 2 )]) exists, where the last line now comes 
from using a strong law of large numbers for triangular arrays 1126*1 . and the definition and properties of ~. Hence 
by uniform integrability 

L J A- + ME — 
If we now assume all g^ are exponentially distributed with mean 1/A, then 
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Cj2 VAM(j2 A 2 M 2 (j4 
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1 + 1 
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2<j% 
\ 2 Moi 



Act?, 



MX2 < + ^ 



which converges to (4y + j^-) at the rate 1/M. ■ 

The limit (4, + ^r)" 1 for D as M — >■ oo was also previously shown in iTTTTl . though the rate of convergence was 
not derived. 
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Fig. 1. Multi-sensor diversity scheme. Comparison between simulated expected distortion and asymptotic expression. 

E. Comparisons and discussions 

The limit ^rr^i = (~z + -pz)^ 1 in the multi-sensor diversity scheme corresponds to the distortion that can be 
achieved with a single sensor, with estimation performed at that sensor, i.e. no further analog forwarding to a 
fusion center. For the channel-aware ALOHA scheme, the limit is <r|(l — i) + ^ $r%2 , which is clearly larger than 
the limit in the multi-sensor diversity scheme. It can be regarded as a weighted combination of the limiting value 
-^7^2 when there is a successful transmission, and the distortion ai when transmissions are unsuccessful, with = 
being the asymptotic probability of successful transmission as M — > oo (which also corresponds to the asymptotic 
throughput of a slotted ALOHA system lfT8l . (271). We note also that the limit (-^ + j^t) 1 in the orthogonal 

scheme using a% = 1/vM, Vi is different from the limit in the diversity scheme. Under the choices of a>i in this 
paper, the expected distortion goes to zero only in the multi-access schemeQ 

In terms of speed of convergence, the rate 1/M is achieved in the multi-access and orthogonal schemes. On 
the other hand, we get a slower convergence rate of l/m(M) in the diversity schemes. A similar l/ln(M) rate 
is achieved when sensor measurements are transmitted to a fusion center digitally using separate source/channel 
coding, e.g. as in the CEO problem (7J, j28l . 

Finally, in regards to implementation, the multi-access scheme requires that we the measurements add up 
coherently as in (Q]) at the fusion center, which may be difficult to achieve for large sensor networks, since it 
requires distributed transmit beamforming to be implemented. The orthogonal access scheme does not require as 
much synchronization between sensors ifTTI . but each sensor will require its own orthogonal channel. The multi- 
sensor diversity scheme does not have these issues, though it will still require the fusion center to determine which 
sensor has the best channel, with this information then fed back to the sensors. The channel-aware ALOHA scheme 
is probably the easiest to implement in practice, however asymptotically it has larger expected distortion when 
compared to the multi-sensor diversity and multi-access schemes. 

F. Numerical studies 

Consider an example with er| = 1, a% = 0.2, a\ = 0.1, and let Mi be exponentially distributed with mean 1/2. 
Note that then E[^) = + ^j)" 1 = 0.1667, + = 0.1667, and <jf(l- §) + = 0.6934. 

In Fig. [j]we compare between the simulated expected distortion (averaging over 100000 channel realizations) and 
the asymptotic expression ([3]) for the multi-sensor diversity scheme, for different numbers of sensors M. In Fig. [2] we 
compare between the simulated expected distortion and the asymptotic expression (@]) for the channel-aware ALOHA 
scheme, for different numbers of sensors M. In Fig. [3] we compare between the simulated expected distortion and 
the asymptotic expression © for the multi-access scheme. In Fig. [4] we compare between the simulated expected 
distortion and the asymptotic expression (O for the orthogonal access scheme. In each case, the validity of the 
respective asymptotic expressions for large M is confirmed. 

'However if e.g. we use m = l,Vi, then the expected distortion will also go to zero in the orthogonal scheme. 
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Fig. 2. Channel-aware ALOHA scheme. Comparison between simulated expected distortion and asymptotic expression. 




Fig. 3. Multi-access scheme. Comparison between simulated expected distortion and asymptotic expression. 



O simulated E[D] 




0.16 ■ ' — ■ ■ — ■ ■ — 

10° 10 1 10 2 10 3 

M 



Fig. 4. Orthogonal access scheme. Comparison between simulated expected distortion and asymptotic expression. 
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We also see that in the channel-aware ALOHA scheme, the expected distortion is not necessarily monotonically 
decreasing with the number of sensors, though for large M the l/ln(M) decay will still occur. 



IV. General parameters 

In this section we investigate how the results of Section [III] change when the sensor noise variances are not 
necessarily identical, and the fading channels are not necessarily identically distributed. The idea is to obtain upper 
and lower bounds on the expected distortion which asymptotically will have the same scaling behaviour, a similar 
method was used in ||29l in the context of linear state estimation. We will see that in some cases the scaling 
behaviour derived in Section HIT] is still preserved, while in other cases not much can be said in general. 



A. General sensor noise variances 

We consider here the case where the sensor noise variances af,i = 1, . . . , M are not necessarily identical, though 
the fading channels are still assumed to be i.i.d. across sensors. We assume that the sensor noise variances can be 
bounded from both above and below, i.e. 

< o- 2 min < of < altax < oo,\/i 

Then we note in all the different schemes considered here, D is an increasing function of of for all i. Hence we 
can upper and lower bound D with the symmetric results using cr| = o^^Vz and erf = o^^Vz respectively. 
In the multi-sensor diversity scheme, we have for Rayleigh fading 
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^ m ax(^ + ^max)H M ). 



(1 + 0(1)) 



Note that the upper and lower bounds do not converge to the same limit as M — > oo, so for general sensor noise 
variances one can not say much more about its asymptotic behaviour. Indeed, one can construct situations that can 
be shown to not converge to any limit, in a similar fashion as in (291. 
In the channel-aware ALOHA scheme, for Rayleigh fading we have 
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1 + 



(l + o(l)) 



Similarly, little more can be said about the asymptotic behaviour for the channel-aware ALOHA scheme in general. 
On the other hand, in the multi-access scheme, we will have 

<M + °l {1 + o(1)) < m < %|M±^(i + 0( i)) 



Since the upper and lower bounds both converge to zero at the rate 1/M, the general situation will also have the 
same scaling behaviour as the bounds. 

In the orthogonal scheme, we have for Rayleigh fading 
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(l + o(l)) 



Here, both the upper and lower bounds converge to (-^ + j^) 1 at the rate 1/M, and so the general situation 
will also do so. 
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B. Non-identic ally distributed fading channels 

In the previous subsection where the sensor noise variances were different but the fading channels were still i.i.d., 
we found that the asymptotic behaviour was still preserved in the multi-access and orthogonal access schemes. We 
now consider the situation where the sensor noise variances are identical (of = of, Vi), and the fading channels are 
independent but not necessarily identically distributed, though for tractability assuming that the fading distributions 
belong to the same "family". To be more specific, we make the following assumption: 

Assumption 4.1: The channel gains c/j can be written as 



9i 



where m? > are constants satisfying 



< Mr, 



< ULi < 



Mi S Mr. 



< oo, 



and the hfs are identically distributed. 

For example, if gi is exponentially distributed with mean 1/Aj, then we can take Mi = 1/%, and hi will be 
exponentially distributed with mean 1, satisfying Assumption 14.11 

Consider first the multi-sensor diversity scheme. We rewrite max(f/i, . . . , c/m) = max(Mi/ii, . . . , Mm^m)> and 
then we have 

max(Mmin^l> • • • , HminhM) < max^l^l, • • • , MM^A/) < max^moa^!, • • • > Mmax^M ) 



We may then obtain for Rayleigh fading the bound 
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The upper and lower bounds both converge to o^of / (oj + of) at the rate 1/ In M. So for non-i.i.d. fading channels 
satisfying Assumption 14. 1 1 and identical sensor noise variances, the scaling behaviour of Section HIT] is preserved in 
the multi-sensor diversity scheme. 

For the channel-aware ALOHA scheme, we may similarly obtain for Rayleigh fading the bound 

1 alal i 



1. 



+ 



eo 2 a + al 



1 



< E[D] < o|(l 



. ln(M) 



In + 1 <W 



1 + 



^0 



1 



0-2 (oj + o-2\ l n (M) 



^ + «(!)) 



which also preserves the scaling behaviour of Section 
For the multi-access scheme, we will have 

2 



< 



< 



M 



'Ei^VmaxhiafoZ + of T,i=lVi h i a lrf + a n Ei=l Mmm^af^ + ^ 



and by similar calculations to Section [TTTJ we may obtain the bound 



°"«Mr, 



*il±4(l + o(l)) < E[£>] < ^ mc ' 



EN + a |(i + o(i)) 



MM mQ x(E[V^]) 2V wy - - M,i mm (E[^]) 

The upper and lower bounds both converge to at the rate 1/M, preserving the scaling behaviour of Section 
For the orthogonal scheme, we will have 



M 

E 



Mr. 



Al 



Jiioftal + al 



< 



M 



Mr. 



by making use of the fact that 



Y ! 

Liihiafol + cr,2 

Hihiafol + a 2 



< 



E 



Mr, 



hiatal + a 2 , 



X Mr, 
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is an increasing function of /ij. We may then obtain the bounds for Rayleigh fading: 

However, since the upper and lower bounds have different limits as M — > oo, little more can be said in general. 

C. General sensor noise variances and non-identically distributed fading channels 

By combining the results in the previous two subsections, it is clear that if we allow for both general sensor 
noise variances and non-identically distributed fading channels satisfying Assumption [4J] then only the multi-access 
scheme will preserve the scaling behaviour of Section |III] 

V. Optimal power allocation 

In this section we consider optimal power allocation for the multi-sensor diversity and channel-aware ALOHA 
schemes. For notational simplicity, and since we are also interested in the performance using optimal power 
allocation for large numbers of sensors, we will consider symmetric sensor networks, although the results can be 
generalized to general parameters such as unequal sensor noise variances and/or non-identical fading distributions as 
considered in the previous section. Numerical results will show that the difference in performance between optimal 
power allocation and the constant power allocation used in Section [III] is very small. Indeed, we will argue that 
asymptotically the results are equivalent. Optimal power allocation for multi-access and orthogonal access schemes, 
with slightly different objectives and constraints, has previously been studied in [10] and ifTTI respectively and will 
not be considered here. 



A. Multi-sensor diversity scheme 

We are interested in minimizing the expected distortion E[D] subject to an average power constraint V. For the 
multi-sensor diversity scheme we can write this as 



2^2 



minE[D] = min 



at a 



s.t. E[a?.] < — ^ 

We have the following result: 

Lemma 5.1: Consider the following problem 

minE 



■E 



1 + 



2 I u„ 



1 



.Qmaxaf, + b_ 



s.t. E[a&] < 



V 



al + al 



The optimal solution is of the form 



9max ^ b V 



where the Lagrange multiplier v satisfies 



1 




b 



otherwise 



Qmax ^ draax 



p(9max)dg n 



V 



a 2 e +al 



(7) 



(8) 



(9) 



Proof: The derivation uses similar techniques to the capacity maximization problems for fading channels in 
OOl . Ifl6l . and is omitted for brevity. ■ 
Using Lemma l5Tl the optimal power allocation for problem {/J) is given by ([D, with b = °T g ■ The expected 
distortion under optimal power allocation can be computed as 



E[D] 



2 2 



1 + 



oi al 



max )dg 



x + 



I) 2 1 



<? 2 eP{gmax)dg r , 



(10) 



where u satisfies (O, and can be determined numerically. 
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B. Channel-aware ALOHA scheme 

For the channel-aware ALOHA scheme, the problem of minimizing the expected distortion subject E[D] to an 
average power constraint V can be written as 



minE[L>] = mincr| 



y M' 



,M-1 



,M-1 



00 rr 2 rr 2 



1 + 



a t9i + sjr 



p(9i)dgi 



s.t. M I a 2 p(gi)dgi < -5- — ? 



(11) 



Similar to the multi-sensor diversity scheme, we have the following result: 
Lemma 5.2: Consider the following problem 

coo 



1 



POD 

s.t. / a 2 p(gi)dgi < 
Jt 



p(9i)dgi 



V 



M{aj + a 2 ) 



The optimal solution is of the form 



, 9i >m a x(T,b 2 v) 
otherwise 



9i» 9 





where the Lagrange multiplier v satisfies 



00 

/ [J )p{9i)dgi 

J VV 9i v 9iJ 



max(T,b 2 i/) 



M(a$ + o*) 



(12) 



(13) 



Using Lemma 15^21 the optimal power allocation for problem (fTTI) is given by (fT2l . with b = a ^ a2 ■ The expected 
distortion under optimal power allocation can be computed as 



E[D) =4 



M-l 



2^2 



1 + 



a" a, 



n u 9 



max(T,b 2 vj 



a v( a e + a v) V 9i 



— p(9i)dgi 



max(T,6 2 i/) 



(14) 



+ M(1-^) M - 1 J a 2 e p(g t )dg t 
T 

where v satisfies (fT"3T ). 



C. Numerical studies 

We again consider a situation with a 2 . = l,a 2 = 0.2, a 2 = 0.1, and let fl^Vi be exponentially distributed with 
mean 1/2. For a fair comparison with the results of Section UlI-FI when performing optimal power allocation we 
will take V / {a 2 e + <r 2 v ) = 1. 

In Fig. [5] we plot the expected distortion under constant (when the sensor is transmitting) and optimal power 
allocation, for the multi-sensor diversity scheme with different numbers of sensors. In Fig. [6] we plot the expected 
distortion under constant and optimal power allocation, for the channel-aware ALOHA scheme with different 
numbers of sensors. The performance using constant power allocation can be seen to be very close to the performance 
under optimal power allocation, particularly for large numbers of sensors. In the next subsection we will attempt 
to explain this phenomenon. 

D. Asymptotic behaviour under optimal power allocation 

In this subsection we will prove why the optimal power allocation and constant power allocation schemes perform 
so close to each other, especially for large M. We will assume that gi are exponentially distributed with mean 1/A. 
We will also take V/(a^ + a 2 ) = 1. 
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SL 0.24 




Fig. 5. Multi-sensor diversity scheme. Comparison between constant and optimal power allocation 



- constant power allocation 

- optimal power allocation 



0.685 - 
0.68 - 
0.675 - 
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Fig. 6. Channel-aware ALOHA scheme. Comparison between constant and optimal power allocation 



1 ) Multi-sensor diversity scheme: Before we state and prove the main theorem, we first give a preliminary result. 



Lemma 5.3: For the multi-sensor diversity scheme under optimal power allocation, v — > as M — > oo, where v 
satisfies (©. 

See Appendix |B] for the proof of Lemma 15.31 We will now prove the following: 

Theorem 5.4: For the multi-sensor diversity scheme under optimal power allocation, 



E[Z>] 



1 + 



X 



as M — > oo. 



ol{ol+al)HM)\ 
Proof: Firstly, by using similar techniques to Appendix |A] we can derive that 



r°° i 



and 



f°° 1 

L i M(i - e " 

By Lemma [531 and (fT3T)-(fT6l). the condition 



Xx) M-l Xe -Xx dx 



\x\M—l \ „—\x 



X 



Xe dx ~ 



ln(M) 
A 



ln(M) 



b 2 u 



9max V 9n 



p{.9max)dg max — 1 



(15) 



(16) 
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is asymptotically 



We can easily solve for v to get 



and so 



We also note that 



A 



bX 



z/ln(M) ln(M) 



v ~ 



ln ( M )i + i^ + (4^y) 2 



(17) 



b 2 u \ X 



M(l - e-^^Xe-^dx 



uX 



A 



ln(M) ln(M) 



Hence from (fTOl) . 



- ((&)") 

1 

ln(M) 



+ ^(1 





1 + 


a 2 n a 2 e A 


aj + a% 


a2(a| + ^)ln(M) 




1 + 


o£a| A 


a% + a% 


a 2 (a 2 + a 2 )HM) 



-\b 2 u\M 



which is the same asymptotic expression as (0 of Section [TTT1 ■ 
2 ) Channel-aware ALOHA scheme: We again first give a preliminary result before stating and proving the main 
theorem. 

Lemma 5.5: For the channel-aware ALOHA scheme under optimal power allocation, T > b 2 u for M sufficiently 
large, where T = \ ln(M) and u satisfies (fT3l) . 

See Appendix |Cl for the proof of Lemma 1531 We will now prove the following: 

Theorem 5.6: For the channel-aware ALOHA scheme under optimal power allocation, 



E[£]~a e 2 (l- 

e e ai + at 



1 + 



A 



a 2 (a 2 + a 2 )]nM 



as M — > co. 



and 



Proof: Recall that T = j ln(M). First note that we can compute the following integrals: 

poo 1 

/ — Xe~ Xx dx = VXKerfc(VXT) = V^7rerfc( v /ln( A 0) 
f°° 1 

/ -\e- Xx dx = XE^XT) = A£i(ln(M)) 
Jt x 

By Lemma [53] and (fT8T)-(fT9l), the condition 

oo 

max(T,b 2 v) 

is asymptotically 

W^erfc(VKZtf)) - bXExiHM)) ~ 



(18) 
(19) 
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and so 



Then 



Hence from (fl4l) we have 



Avrerfc( v /ln(M)) 
1/M + b\Ei(ln(M)) 

- 1„(M) 



'Avr 



y/lT ln(M) 



1/M + 6A- 



ln(M) 



A 



ln(M) 



Xe- Xx dx 



max(T,b 2 u) 



T 



Xe- Xx dx 



\/^A7rerfc( v /ln(M)) 

"= e -ln(M) 

A 



ln(M) ^/vrln(M) 
A 



Mln(M) 



E[D] ~<7|(1- -) + M- 



1 a e V, 2 



1 

77 + 



2^2 



A 



oi(l --) + - 



1 <r|<7-2 



e at + cx,1 



1 + 



A 



which is the same asymptotic expression as ((U) of Section | 



VI. Optimal threshold selection for channel-aware ALOHA scheme 

So far in this paper we have used the choice of threshold T = i ln(M) in the channel-aware ALOHA 
scheme. In this section we will consider the optimal choice of threshold in the channel-aware ALOHA scheme for 
symmetric sensor networks. We consider both threshold optimization under constant power allocation, and a joint 
threshold/power optimization. We will assume Rayleigh fading, so that gi are exponentially distributed with mean 
1/A. 



A. Optimal thresholds under constant power allocation 

Recall that in the channel-aware ALOHA scheme each sensor transmits when g^ > T. The problem we now 
consider is to determine the optimal choice of T to minimize the expected distortion. 

Note that under Rayleigh fading, Pr(<?j > T) = e~ XT . For a fair comparison with the model of Section Hl-B I we 
will normalise the powers, and let oti be of the form 



1M 



The expected distortion can then be derived similar to Section IIII-BI as 



E[D] 



Me _AT (l - e 



-\T\M-1 



+ M(1 



-\T\M-l 



1 



gi e XT /M 



T W 9ia 2 e XT /M + a 2 



p(9i)dgi 



Me~ XT (l - e 



-\T\M-1 



M(l 



2 2 

e -\T\M-l a 6 (J v 



XT a 2 n a 2 Me~ XT x / Xa 2 Me~ XT 
e + o/o n, A exp ' " 



a 2 (a% + a 2 



ai + a. 



V 



lxt a 2 n Me- XT ^ 
E 1 \X\ V- +T 

at + at , 



(20) 
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The optimal threshold can then be found by numerically searching for the T* that satisfies ^3 \ t=t* = and 

5. /oinf threshold/power optimization 

Here we wish to optimize both the threshold and determine the optimal power allocation that will minimize the 
expected distortion, subject to an average power constraint. The problem can be written as 



mm On 



1 _ Me~ XT (l - e~ XT ) M ' 1 
V 



+ M{1 - e-^M-i f°° ( 1 + 



p(§i)dgi 



(21) 



/■OO 

s.t. M / a 2 iP {gi)dgi < - 



+ < 



To solve ([2T]) . we note that for a given T, it can be shown similar to Section IV-B I that the optimal power allocation 
has the form 



ft; 



9,v 9 





where v satisfies 



oo 

/ I \ ) p{gi)dgi 

J VV 9% v 9iJ 



otherwise 



V 



M(o 2 g + o 2 ^ 



raa,x(T,b 2 u) 



and 



E[D] =oj 1 - Me~ XT (l - e - XT ) M ~ l 

m&x(T,b 2 u) 



cr 2 a + O? 



max(T,b 2 v) 



+ M(l-e--)-- 1 / ^fl + ,J^ g ) /X.7,H* 



^K + ^) V 



+ M(l-e~ XT ) M - 1 J o 2 eP (g t )d gi 

T 

With this, we may then again perform a line search to find the optimal T* that minimizes E[_D]. 



(22) 



C. Numerical studies 

We again consider the situation with o 2 = l,o 2 = 0.2, o 2 = 0.1, and let gi,Vi be exponentially distributed with 
mean 1/2. 

In Figures [7] and [8] we plot the thresholds and expected distortion under constant power allocation, comparing 
the performance using optimal thresholds and the simple choice of threshold T = iln(M). The results can be 
seen to be very close to each other. 

In Figures [9] and [TO] we plot the thresholds and expected distortion, comparing the performance using optimal 
power allocation with optimal thresholds, and constant power allocation with the simple threshold T = j ln(M). 
The results can also be seen to be very close to each other. 

D. Optimal thresholding for large M 

From the numerical results in the previous subsection, it appears that the optimal thresholds (under both constant 
power and optimal power allocation) are asymptotically equal to ^ln(M). Indeed, we have the following result: 

Lemma 6.1: Under both constant power and optimal power allocation, the optimal thresholds T* satisfy T* ~ 
^ m(M) as M — > oo. 

Proof: Regard T as a function of M. Consider the term 

Me -AT(M)^ _ e -AT(M))M-l 
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Fig. 7. Constant power allocation. Simple and optimal thresholding 
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Fig. 8. Constant power allocation. Simple and optimal thresholding 
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Fig. 9. Constant power allocation and simple thresholding vs optimal power allocation and optimal thresholding 
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Fig. 10. Constant power allocation and simple thresholding vs optimal power allocation and optimal thresholding 



in both the expressions (1201) and (1221 . If the thresholds are chosen such that this term decays to zero as M 
then in both © and © we have a 2 [l - Me~ XT ^ M \l - e -*W)M-i] ^ and hence 

E[D] > oJ(l + o(l)) as M 



oo, 



oo. 



However, we already know from Section IIII-BI that the choice T(M) = j ln(M) results in a lower expected 
distortion than this. Thus a necessary condition for the optimal choice of thresholds T*(M) is that the term 

Me~ XT *( M \l - e -^T'(M)^M-i does not converge to zero as M oo. 

Now for the term Me" AT *' M ' to not converge to zero, one needs T*(M) < ^ln(M)(l + o(l)). For the term 
(1 - e -^T*{M)yd-i tQ nQt conver ge to zero, one needs T*(M) > ±ln(M)(l + o(l)). Combining these two 
statements, one then gets that the optimal thresholds must have the form T*(M) ~ j ln(M). ■ 

Intuitively, one could next attempt to substitute T* ~ j ln(M) into d20l ) or (|2TI ) in order to obtain the asymptotic 
expression (0]) for the expected distortion. This however is not a rigorous argument since performing the operation 



-AT* 



does not retain the asymptotic relation ~. We can prove however, the following weaker result: 



Lemma 6.2: Under both constant power and optimal power allocation, and optimal thresholding, we have 



+ 



1 aia. 



2^2 



e u v 



ea 2 e +a 2 v 



[l + o(l))<E[D}<a$(l 



+ 



1 



e al + al 



1 + 



A 



a 2 (aj + a 2 ) In M\ 



as M — > oo. 

Proof: The upper bound on K[D] comes from the fact that the sub-optimal choice T = j ln(M) with constant 
power allocation gives the asymptotic behaviour (0]) in Section IIII-BI For the lower bound, consider the term 



CTfl 



1 - Me" AT (l 



-\T\M-1 



+ Me 



-XT , 



2^2 



1 



-\T\M~1 a e a v 



in either d20l or ([2Tb . One can easily show that this term is minimized by using T = j ln(M), resulting in 



1 - Me" AT (l 



-AT\ Af — 1 



+ Me' XT (l 



-\T\M-l 



O 2 + 0-2 



^(1 



1-(1 

1> 

e' 



+ 



1 \M-1 

m' 

1 oWv 

eol + a 2 



+ (1 



2 2 

M-i <J e <J v 



era + al 



Hence from either (f20l) or (HQ), E[D] > (o" 2 (l 



(1 + 0(1)). 



1 



at a rate at least as 



By Lemma [6721 we see that E[D] will go to the same limiting value ct 2 (1 — i) + 
fast as l/ln(M). However, showing that the rate is exactly l/ln(M), and that the exact asymptotic behaviour is 
given by (01), remain open issues. 
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VII. Conclusion 

The asymptotic behaviour for decentralized estimation of an i.i.d Gaussian source, using the analog amplify 
and forwarding technique under a number of different multiple access schemes, has been studied. Focusing on the 
expected distortion, the rate of decay of l/ln(M) has been shown for multi-sensor diversity and channel-aware 
ALOHA schemes, while the coherent multi-access and orthogonal access schemes have decay rates of 1/M. The 
optimal power allocation for the multi-sensor diversity schemes has also been derived, and we have found that 
simple power allocation policies can actually approach the optimal results very closely as the number of sensors 
increases. 

The diversity schemes considered here can obviously be made more sophisticated. For instance, instead of just 
the best sensor transmitting their measurement to the fusion center, we could have the best ./V sensors transmitting, 
with N > 2. This could be useful in particular when the sensor measurements are spatially correlated. For another 
example, in the channel-aware ALOHA scheme, instead of assuming collision when more than one sensor transmits 
at the same time, we might be able to combine them by coherently adding up the sensor transmissions as in the 
multi-access scheme. Analysis of these schemes will be more complicated, but could constitute possible areas of 
future investigation. 



Appendix 

A. Proof of Lemma \3.1\ 

Proof: The maximum of M i.i.d. exponential random variables with mean 1/A, has cumulative distribution 
function 

F(x) = (1 - e~ Xx ) M 

and hence the probability density function 

p(x) = M(l - e- Xx ) M - l \e- Xx . 
We wish to find the large M behaviour of 

E — !— = M \ ^—^ >—— dx 

_X + b\ J x + b 

roo „—Mt 
= M / = dt 

Jo 6-±ln(l-e-*) 

where in the second line we used the substitution e~ l = 1 — e~ Xx . To determine the asymptotic behaviour of the 
integral 



oo e~ Mt 



-dt, 



io b — j ln(l — e~ -) 

we will use a Tauberian theorem for the Laplace transform, see p.445 of OTTl or p. 248 of [32], which in our notation 
says that if f(t) > 0, < p < oo, and L(t) is a slowly varying function at infinity, then each of the relations 



and 



J" e- M, f(t)dt~ M-'l(J^\ asM 



OO 



implies the other. 

Thus we can study first the asymptotic behaviour of 



1 



o 6-iln(l-e- T ) Jo A6-ln(l-e 



dr = X — — ; -dr 
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as t — > 0. Using an integration by parts, we obtain 



1 



Xb - ln(l - e~ T 



-dr 



re 



A6-ln(l-e-*) J (1 - e- T )(Xb - ln(l - e^)) 2 



dr 



Next, it may be verified that re T /(l — e r ) < 1, and that 1/(A6 — ln(l — e r )) 2 is an increasing function of r. 
Then 



re 



o (l-e- T )(A6-ln(l-e-^)) 2 
* re- 



o (l-e- r )(A6-ln(l-e—)) 2 



rfr 



< 
< 



1 



o (A6-ln(l-e-)) 2 
t 

(A6-ln(l-e-*)) 2 
t 

Aft - ln(l - e-*; 



rir 



as i — )• 



and so 



1 



-dr 



Xt 



Xb - ln(l - e~ T ) Xb - ln(l - e~*) 

At At 



A6-ln(t) A6 + ln(l/t) 

as t — ^ 0. With L(t) = X b+\n(i/t) ( wrncn can be easily shown to be slowly varying) and p = 1, we thus have by 
the Tauberian theorem that 



M 



-Mt 



o &-±ln(l-e- 



-dt^Mx M' 1 x 



A 



Xb + ln(M) 



ln(M) 



as M — > oo 



B. Proof of Lemma \5.3\ 

Proof: The proof is by contradiction. Regard v{M) as a function of M. 
Suppose v(M) does not converge to as M — > oo. Then there exists a constant u > such that v{M) > v for 
infinitely many values of M. In particular, there are infinitely many values of M such that the following is true: 



b 2 v(M) 



' M(l - e- Xx ) M ~ l Xe- Xx dx < I -J=M(1 - e~ Xx ) M - l Xe~ Xx dx 



xu(M) 




e~ Xx ) M - l Xe~ Xx dx 



Pln(M) 



where the last line comes from (fT5T ). Since 

6 
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the condition 



1 b 



b 2 



u(M) \ V QmaxViM) Q Tl 



P(9inax)dg ma x — 1 



thus cannot be satisfied for all M, which is a contradiction. 

C. Proof of Lemma 15.51 

Proof: Call a = max(T, b 2 v) = max(± m(M), b 2 v). Then 



[ (J— - — ) Xe-^-dgi = J— erfc(VAa) - 6A£i(Ac 

Ja \ \ di" 9iJ V ^ 



From (fT3l) we obtain 





— erfc(\/Aa) = bXEi(Xa) + — . 
Now by definition of a, we have a > j ln(M), or e _Aa < -A?. Hence 

A ^erfc(\/A^) > bXEx(Xa) + e" Aa 

Also note the inequality erfc(\/Ao) < e _Aa . Then 

\/Awerfc(\/Aa) e~ Aa \/A7r _ \^Xtt r— 

^ V ~ bXE x (Xa) + e~ Xa ~ bXE^Xa) + e~ Xa ~ 1 + bXe^E^Xa) ~ * 

Thus y/v < \ZXtt < y/ ln (My\ f or m sufficiently large, which then proves Lemma 15.51 
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